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(57) Abstract 

A method and system for measuring the speech quality in a mobile cellular telecommunications network using available radio link 
parameters is disclosed herein. In a preferred embodiment, the method includes receiving a set of radio link parameters, as denned 
in a standard or otherwise available, such as the BER, FER, RxLev. handover statistics, soft information, and speech energy. Temporal 
information is obtained from the radio link parameters to create a set of temporal parameters which can be statistically analyzed, for example, 
for the maximum and minimum, mean, standard deviation, and autocorrelation values for a time interval. The temporal parameters are 
combined to yield a set of correlated parameters that are more closely related to the speech quality. An estimator then uses the correlated 
parameters to calculate an estimate for the speech quality. The method of the present invention takes advantage of temporal information 
and correlated relationships from the transmitted parameters. Furthermore, the method is inherently simple and reliable as compared to 
prior art methods. Still further, the technique provides a method and allows operator to monitor quality conditions throughout the network 
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Speech Quality Measurement In Mobile Telecommunication Networks 

Based On Radio Link Parameters 



FTFI.DOF IN VENTION 

The present invention relates generally to speech quality measurement in 
wireless telecommunication systems, and pertains more specifically to a method of 
measuring the speech quality using radio link parameters. 



RAP^nROIIND OF T HF INVENTION 

In the wireless telecommunications industry, cellular service providers are 
intensely interested in providing high quality, reliable services for their customers in 
today's highly competitive environment. For example, reliability problems such as 
dropped calls and quality issues such as fading, multi-path interference, and co- 
channel interference are concerns constantly facing cellular operators. Another issue 
of great interest to operators is the improvement of perceived speech quality by the 
end user within the cellular system. Therefore, it is desirable for operators to be able 
to determine which areas in the network are experiencing quality problems. 

There have been a number of methods used in the past to measure speech 
quality in cellular networks. One commonly used method involves testing a cellular 
network by transmitting known signals and comparing the received signals to a 
predefined signal database to determine an estimate for the quality. The term signal is 
used herein to refer to sounds perceptible in the human audio frequency range which 
include speech and tones. This method is illustrated in Figure 1. Depicted is a known 
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signal database 2, wherein predetermined signals are sent through a system under test 
4. The system under test 4 represents all the functioning components of a cellular 
network which includes a mobile switching center (MSC), a radio base station (RBS), 
all communication links, and the air interface. Once the transmitted signals have been 
received, a second signal database 6 containing the original signal patterns are 
compared to the received signals at step 8. An estimate is then calculated for the 
quality of the received signal for the network. 

In digital systems, the conversion of analog speech signals to digital signals 
requires much more bandwidth for transmission than is desirable. Bandwidth 
constraints in wireless telecommunication systems have spawned the need for low bit- 
rate speech coders which work by reducing the number of bits that are necessary to 
transmit while preserving quality and intelligibility. In general, it is desirable to 
transmit at lower bit-rates but quality tends to diminish with decreasing bit rates. The 
speech coders used in these applications work by encoding speech while removing 
15 redundancies embedded during speech production. 

Typically, speech coders obtain their low bit-rates by modeling human speech 
production in order to obtain a more efficient representation of the speech signal. The 
original speech signal can be synthesized using various estimated filter parameters. 
Since many of the prior art testing methods include the use of audio tones in the 
testing procedure, they do not lend themselves well for testing with digital systems. 
This is because speech coders are modeled after speech production and are not 
optimized for tones, thus errors in tone regeneration may likely be encountered. 

Another source of potential problems with the method of Figure 1 when 
utilizing speech signals is in the compare and estimate step 8. Speech database 2 
contains a limited number of repeating predetermined sentences (e.g. 6-8 sentences) 
that are representative of speech patterns typically made through a mobile network. 
The estimate portion in step 8 employs perceptual models that mimic the listening 
process. Models of this type are typically very complicated and difficult to formulate. 
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This leads to differences between the model and the subjective assessment thereby 
leading to sometimes unreliable measurements. 

A predominant factor affecting speech quality in digital systems is the bit error 
rate (BER). Bit errors tend to be introduced during transmission over the air interface. 

5 The BER is the frequency at which these bit errors are introduced into the transmitted 
frames. High BER situations often occur during conditions of high co-channel 
interference, weak signals such as mobile roaming out of range, and fading caused by 
multi-path interference due to obstructions such as buildings etc. Although attempts 
are made at correcting these errors, an excessively high BER has a detrimental effect 

10 on speech quality. 

In a Global System for Mobile Communication (GSM) network for example, 
the BER and other related parameters, such as Receive Quality (RxQual) and Receive 
Level (RxLev), are monitored to assess speech quality. There are shortcomings in 
using this method since correlation relationships and temporal information that can be 
1 5 obtained from the parameters are not taken advantage of to obtain parameters that are 
more closely related to the speech quality. For example, the extraction of temporal 
• information permits the formulation of a host of relationships between the variables 
that can be taken advantage of for measuring speech quality. It is known that the 
perceived speech quality for the end user is associated with time averaging over a 
20 length of a sentence at its highest resolution. The final quality is averaged over the 
whole conversation meaning that the lowest resolution is approximately in the range 
of several minutes. Therefore the use of derived temporal and correlated parameters, 
which is lacking in GSM, will give clearer insight as to the state of speech quality 
experienced for many situations. 

25 The RxQual parameter in the GSM system is measured every 0.5 seconds and 

is inherently dependent on the BER for each 20 millisecond frame. Further, RxQual 
can fluctuate widely due to fading, noise or interference which can lead to quality 
measurements that fluctuate much faster than the perceived speech quality. One 
seemingly obv.ous solution would be to increase the temporal resolution with a time 
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constant in the area of 2-5 seconds. But it has been found that the relationship 
between the digital communication link and speech quality is not solely dependent on 
a time averaged BER. 

What is needed is a method that is both simpler and more accurate than using 
signal databases and takes advantage of correlation relationships and temporal 
information from radio link parameters. A further objective is to provide an effective 
method, using available parameters, that allows operators to monitor quality 
conditions throughout the network. 



10 SUMMARY OF THE INVENTION 

To achieve the foregoing and other objectives in accordance with the present 
invention, a method and arrangement for measuring the speech quality in a mobile 
communications network is disclosed herein. In a preferred embodiment, the method 
includes receiving a set of radio link parameters, as defined in a standard or otherwise 

15 available, such as the BER, FER (Frame Erasure Rate), RxLev, handover statistics, 
and soft information. The radio link parameters are processed to retrieve applicable 
temporal information which are used to calculate a set of temporal parameters. The 
temporal processing also includes, if necessary, transforming the radio link 
parameters in the time domain to obtain more tractable shapes. The transformed data 

20 can then be statistically analyzed, for example, for the maximum and minimum, 
mean, standard deviation, and autocorrelation values for any prior time interval. The 
newly calculated temporal parameters and radio link parameters are then correlated to 
yield a set of correlated parameters that are more closely related to the speech quality. 
An estimator using the correlated parameters, then calculates an estimate for the 

25 speech quality. 

In an apparatus aspect of the present invention, a functional apparatus, for 
measuring the speech quality in a cellular telecommunication network is described. 
The apparatus is comprised of three functional stages wherein the first stage, a 
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temporal processing stage, is arranged to receive a set of radio link parameters 
contained in a frame of data transmitted from a mobile station. The temporal 
processor calculates a set of temporal parameters to be entered into the correlation 
processing stage. The correlation processing correlates the temporal parameters to 
derive relationships between the parameters that are more closely related to speech 
quality. The correlated parameters are then entered into an estimator stage to calculate 
an estimate of the speech quality. The estimator may be based on a linear or non- 
linear estimation. Furthermore, the estimator may be comprised of a neural network, 
or a state machine configured to change state in response to a change in a dynamic 
variable such as the speed of a moving mobile station or a change from frequency 
hopping to non-frequency hopping. 

The present invention using radio link parameters provides an inherently 
simple and reliable method of measuring the speech quality in a cellular network. 
Furthermore, the dynamic nature of the technique allows the operator to be constantly 
updated on the quality conditions in all parts of the network. These and other 
advantages of the present invention will become apparent upon reading the following 
detailed descriptions and studying the various figures of the drawings. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The invention, together with further objectives and advantages thereof, may 
best be understood by reference to the following description taken in conjunction with 
the accompanying drawings in which: 

Figure 1 shows a prior art method of measuring speech quality using signal 
databases; 

Figure 2 shows a method of measuring speech quality in a mobile 
communications network in accordance to an embodiment of the present invention; 

Figure 3 shows a block diagram of the quality measurement procedure in 
accordance with an embodiment of the present invention; and 

Figure 4 shows a graph of an exemplary parameter correlated to speech 

quality. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

A discussion of Figure 1 directed toward a prior art method of speech quality 
measurement was provided in the preceding sections. In a basic cellular system, a 
mobile switching center (MSC) is linked to a plurality of base stations (BS) that are 
geographically dispersed to form the area of cellular coverage for the system. Each of 
the base stations are designated to cover a specified area, known as a cells, in which 
two way radio communication can then take place between a mobile station MS and 
the BS in the associated cell. The quality level of coverage is not uniform for all 
points in the coverage area because of various uncontrollable factors. Therefore the 
perceived quality by the end user provides important information about the current 
performance level of the network. A description of a method for measuring speech 
quality in the network by monitoring radio link parameters follows. 
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Figure 2 illustrates the basic concept of utilizing radio link parameters, that are 
available in e.g. an MS, BS, and MSC for a typical TDMA based network. By way of 
example, a transmitter 12 from an associated base station transmits a signal from an 
antenna 14 through the air in the form of bursts of digitally modulated information 
5 (digital packets). In an ideal situation, the transmitted signal would be received in its 
original form without any errors by a receiver 16 in the MS. In practice, distortion 
caused by weak signals (shadowing), multi-path fading, and co-channel interference 
all can introduce errors into the transmission. 

In systems operating in accordance with D-AMPS, for example, voice and 
10 other data are sent in 20 millisecond digital packets, referred to as frames, which are 
further divided into six time slots. In a downlink situation, coded speech data is 
transmitted to an MS using two time slots in each frame and is decoded in a speech 
decoder in the MS. As the frames are transmitted, bit errors introduced by distortions 
on the bit-stream are received and detected by the MS and a bit error rate (BER) 18 is 
15 calculated. A frame containing the data may be marked as "bad" when the number of 
bit errors is above a specified threshold or when checksum errors are detected. The 
rate of occurrence of "bad" designates a frame erasure rate (FER) which is reported 
as parameter 20. A "bad" frame, containing necessary control information and data, 
is not reliable and therefore cannot be used. In this situation, data from a previous 
20 "good" frame is used in an attempt to recover from the bit errors. 

Another parameter reported by the MS is the received signal level (RxLev) 22 
which reports the signal strength. A handover parameter 24, representing statistics of 
handover events, is reported and indicates that the call has been switched to another 
frequency e.g. during an intercell handover situation to another cell. Further, other 
25 parameters 26 containing e.g. soft information are obtained from receiver 16. Soft 
information may contain, for example, information on the quality of the bits in a 
designated frame. A method of using soft information and for improving quality 
estimation is disclosed in U.S. Patent No. 5,432,778 granted to Minde et al. entitled: 
Method and An Arrangement For Frame Detection Quality Estimation in the Receiver 
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of a Radio Communication System issued on 7/11/95 which is incorporated by 
reference herein in its entirety. An estimate of speech quality 28 can then be made 
from the measured parameters as described below. 

In a cellular network, there is a predefined speech communication link, 
therefore a known speech coder/decoder (codec) conforming to a specified standard is 
used. The perceived end-quality of the speech is not only affected by the number of 
bit errors but also on their temporal distribution. For example, a deep fading dip may 
cause a short burst of errors in the bit-stream, which are in close temporal proximity, 
and may in turn cause the channel decoder to fail while decoding. This may introduce 
a frame erasure or may cause an erroneous decoding of speech. Frame erasures can 
be concealed through the repetition of parameter data bits from previous frames, 
which may result in a "synthetic" sound due to the regeneration. Furthermore, 
erroneous speech decoding and synthesis due to the decoding failures may be 
propagated for a few frames and may result in undesirable loud clicks or bangs. Thus, 
a short burst of sequential bit errors may cause the quality to degrade significantly for 
some time. On the other hand, many fast fading dips may introduce a lower average 
residual BER and result in better perceived speech quality since channel decoding is 
able to correct most of the errors. Therefore the foregoing suggests that the temporal 
characteristics of the speech quality-related parameters should be taken into account. 
These parameters carry information about different properties, for example, fading 
rates, fading lengths, fading depths, signal-to-noise ratios, signal-to-interference 
ratios, signal levels and hand-over situations. Therefore it is possible to extract 
additional information about the perceived quality from the correlations and cross- 
correlations of these parameters in time. 

Referring now to Figure 3, a method of speech quality measurement utilizing 
temporal and correlation processing is depicted in accordance with an embodiment of 
the present invention. The preferred embodiment comprises a multi-stage 
configuration that includes a temporal processing stage 32, a correlation processing 
stage 34, and an estimator stage 36. Radio link parameters such as BER, FER, 
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RxLev, H.O., and soft information are input into the temporal processing stage 32. 
From these parameters, new parameters can be calculated. As can be appreciated by 
those skilled in the art, the temporal processing of the parameters can be performed, 
for example, by applying so-called "sliding windows" or simply "windowing" in the 
time domain such as e.g. rectangular, exponential, and hamming (sin 2 window) to 
achieve temporal weighting. The parameters can then be correlated by taking, for 
example, the root, exponential, or log of the function to achieve a more appropriate 
shape. Moreover, the transformed data can be analyzed with statistical methods which 
may include determining the maximum value, minimum value, mean value, standard 
deviation, skewness, kurtosis etc. These processes may be performed independently 
and in any order to achieve the desired relationships. 

Temporal processing in block 32 is desirable to extract temporal information 
from parameters by examining their previous activity during a specified time interval. 
By way of example, the examination a sequence history of measurements for a 
parameter, it is possible to calculate temporal parameters such as mean value for the 
last X seconds, estimate the standard deviation during Y seconds, or the 
autocorrelation function during the last Z seconds. In an example, the mean BER 
during the last 3 seconds or the number of erased frames during last 5 seconds are 
representatives of new temporal parameters for deriving parameters more closely 
related to an aspect of speech quality. 

Correlation stage in block 34 correlates the original or newly calculated 
temporal parameters to produce correlated parameters which are more directly related 
to speech quality. For example, modern cellular systems attempts to conceal the loss 
of a frame due to bit errors by repeating the previous 20 ms frame with the hope it 
will not be heard. This means that the number of bit errors in the lost frame are not 
relevant, since the frame contents never reaches the listener. This suggests that a new 
parameter which correlates more closely with speech quality may be calculated by 
correlating the BER with FrameLoss for instance. 
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In a first example that works well with the present invention and which 
illustrates the use of temporal and correlation processing, the mean for the BER is 
calculated over 0.5 second intervals, in temporal processing stage 32 to create a new 
temporal parameter RXQMEAN5. In correlation stage 34, the RXQMEAN5 
parameter is correlated by applying a third power transformation yielding a 
(RXQMEAN5) 3 correlated parameter. In a second example, the FER is calculated 
over 0.5 second intervals to form temporal parameter FERMEAN5. A third root 
transformation is then applied to temporal parameter FER_MEAN_5 to form a 
correlated parameter (FERMEAN5)" 3 . In a third example, the FER is calculated 
over a 5 second interval to determine the number of consecutive frame erasures to 
form the parameter FER BURSTS 5 . Subsequent correlation is performed by 
applying a square root transformation to the temporal parameter to form a correlated 
parameter (FER_BURSTS_5) 1/2 . A summary of the temporal parameters and 
associated correlated parameters is given below in TABLE A. 



TABLE A 



TEMPORAL PARAMETER 


CORRELATED PARAMETER 


RXQMEAN5 


(RXQ_MEAN_5) 3 


FER MEAN 5 


(FER_MEAN_5) 1/3 


FERBURSTS5 


(FER_BURSTS_5) ,/2 



Other potential parameters may include performing similar operations to the 
residual bit error rate (RBER, where the RBER is equal to zero when the frame is 
erased and equal to the BER when the frame is not erased) and other received 
parameters. It should be noted that temporal processing and statistical analysis may be 
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performed on the correlated parameters and that some, for example, RBER may be 
calculated on ' raw" data. 

Estimator stage in block 36 uses the correlated parameters to calculate an 
estimate of the perceived speech quality. The estimator 36 can be based on varied 
5 mathematical models such as linear, non-linear, or may comprise a neural network. A 
simple linear model can be of the form: 

Estimate = A(Parameter 1) + B(Parameter 1) + ... 

where coefficients A and B are optimized for the best performance. Coefficients may 
be derived, for example, by using a linear regression technique on a subjectively 
10 graded training material. Although linear estimation provides adequate results, as one 
skilled in the art can appreciate, non-linear estimators may provide more accurate 
estimation. 

An exemplary procedure using linear estimation can be performed on the 
correlated parameters of an above example and may take the form: 

15 Estimate = A*(FER_MEAN_5) ,/3 + B* ... 

where coefficients A and B can be derived by the aforementioned linear regression 
techniques which are well known. Moreover, it is possible to combine any number 
and combination of radio link, temporal, or correlated parameters for the estimation 
as determined to be optimal for various situations by one skilled in the art. 
20 Furthermore, specific examples of temporal and correlated parameters have been 
provided and thus various modifications to the described parameters may occur to 
those skilled in the art are viewed to be within the spirit and scope of the present 
invention. In particular, modifications to relationships regarding the temporal and 
correlated parameters and variations in interval lengths may be changed to suit the 
25 particular type of interference or situation experienced. 
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Non-linear estimation may also be performed by multiple linear estimators 
which approximate the nearly-linear portions of a modeled curve. Figure 4 depicts a 
graph of the relationship of Quality (Q) verses the ratio of carrier to interference (C/I) 
using this technique. Curve 60 may be divided into several near-linear segments to be 
5 modeled with the successive linear estimators. For example, segment 62 is steeply 
inclined having little curvature and thus may be represented by a linear model. 
Similarly, segment 64 has a bit more curvature and may also be approximated by a 
linear model. Segment 66 of the curve starts to level out and can be approximated 
quite well with a linear model. In order to provide seamless transition between the 
10 models, it becomes necessary to determine where the current operating point is. A 
method that can be employed to solve this is to use a model to determine the 
probability of being in a specific segment. The linear models used in the multi- 
estimator approach can provide relatively simple and accurate modeling. 

Furthermore, a multi-stage neural network may be employed that produces 
15 more accurate results. Neural networks are networks of processors or neurons linked 
by unidirectional connections that carry data and are weighted accordingly. The 
neurons act independently and operate based solely on their inputs by associated 
weighting. Typically, neural networks require training algorithms to adjust the 
weights on the basis of presented patterns. For example, a training technique that can 
20 be applied to a neural network estimator is to simultaneously record the radio link 
parameters with test speech. The recorded speech is evaluated by a listening panel 
where it is rated. By way of example, the radio link parameters are processed in the 
temporal processing stage 32 and correlation processing stage 34 of Figure 3 where 
the result plus the ratings are used to train the network. As known to those skilled in 
25 the art, an advantage of using a neural network is that processing in stages 32 and 34 
may be less complicated since the network may be better suited to this task than 
ordinary estimators. An example of a neural network that can be used with the present 
invention is provided in U.S. Patent No. 5,432,778, the disclosure of which is 
incorporated herein by reference. 
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Moreover, depending on system characteristics, such as carrier frequency and 
frequency hopping, another type of estimator that may be suitable is one based on a 
finite-state machine that changes state in accordance to some dynamic criteria. For 
example, the estimator can be configured to change state in response to a change in 
mobile speed or the change from frequency hopping to non-frequency hopping and 
vice versa. By way of example, this may be appropriate in situations where the model 
might be different e.g. for a call with frequency hopping compared to one without 
frequency hopping. 

The present invention contemplates a method of measuring speech quality in a 
cellular telecommunication system by monitoring the radio link parameters. The 
foregoing discussion further discloses an inherently simple and accurate speech 
quality estimation technique that avoids the complexities associated with speech 
databases and perceptual models. The present invention exploits the use of temporal 
information of current radio link parameters by calculating new parameters in which 
relationships and cross-correlations between parameters can be utilized for improved 
speech quality estimation. 

Although the invention has been described in some respects with reference to a 
specified preferred embodiment, various modifications and applications thereof will 
become apparent to those skilled in the art. In particular, the inventive concept may 
be applied, in addition to D-AMPS, to other digitally based systems operating in 
accordance with, for example, Code Division Multiple Access (CDMA), Global System 
for Mobile Communication (GSM), or Personal Digital Cellular (PDC). It is therefore 
the intention that the following claims not be given a restrictive interpretation but 
should be viewed to encompass variations and modifications that are derived from the 
inventive subject matter disclosed. 



What is claimed is: 
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CLAIMS 

1 . A method of estimating the speech quality in a radio telecommunication system 
comprising the steps of: 

receiving a set of radio link parameters; 

5 processing temporal information from said radio link parameters to calculate a 

set of temporal parameters; 

correlating said parameters to produce a set of correlated parameters; and 
estimating the speech quality from the correlated parameters with an estimator. 

2. A method according to claim 1 wherein the radio link parameters include at 
10 least one of BER, FER, RxLev, handover statistics, soft information, and speech 

energy parameters. 

3. A method according to claim 1 wherein the step of extracting temporal 
information further comprises the step of transforming the parameters in the time 
domain by performing any one of log, exponential, power operations, rectangular, 

15 exponential, or hamming windowing. 

4. A method according to claim 2 wherein the temporal processing step includes 
calculating the mean BER over a 0.5 second interval and wherein said correlating step 
includes applying a third power transformation to said mean BER. 

5. A method according to claim 2 wherein the temporal processing step includes 
20 calculating the mean FER over a 0.5 second interval and wherein said correlating step 

includes applying a cubed root transformation to said mean FER. 

6. A method according to claim 2 wherein the temporal processing step includes 
calculating the mean FER over a 5 second interval and wherein said correlating step 
includes applying a square root transformation to said mean FER. 

25 7. A method according to claim 1 wherein a time interval length in the range of 
approximately 0.1 to 10 seconds is used in said temporal processing step. 

8. A method according to claim 1 wherein the estimating step is performed by a 
linear estimator. 
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9. A method according to claim 1 wherein the estimating step is performed by a 
non-linear estimator. 

10. A method according to claim 1 wherein the estimating step is performed by a 
neural network. 

5 11. A method according to claim 1 wherein the estimating step is performed by 
multiple linear estimators. 

12. A method according- to claim 2 wherein the estimating step is performed by a 
state machine estimator, wherein the estimator is configured to change state in 
response to a change in any one of said parameters. 

10 13. A method according to claim 12 wherein the estimation is performed by a state 
machine estimator, wherein the estimator is configured to change state in response to 
a change in mobile speed. 

14. A method according to claim 13 wherein the estimator is configured to change 
state in response to a change from frequency hopping to non-frequency hopping and 

15 vice versa. 

15. A system for measuring the speech quality in a radio telecommunication 
network comprising: 

a temporal processor for extracting temporal information from a set of 
available radio link parameters associated with a received radio signal, wherein said 
20 temporal processing generates a set of temporal parameters relating to speech quality; 

a correlation processor for determining the correlation between suitable radio 
link parameters and temporal parameters to generate a set of correlated parameters; 
and 

an estimator for determining an estimate of the speech quality from suitable 
25 generated parameters and radio link parameters. 
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16. An apparatus according to claim 15 wherein the radio link parameters includes 
at least one of BER, FER, RxLev, handover statistics, soft information, and speech 
energy parameter. 

17. An apparatus according to claim 15 wherein the estimator is comprised of a 
linear estimator. 

18. An apparatus according to claim 15 wherein the estimator is comprised of a 
non-linear estimator. 

19. An apparatus according to claim 15 wherein the estimator is comprised of a 
neural network. 

20. An apparatus according to claim 15 wherein the estimator is comprised of a 
state machine configured to change state in response to a variable event such as the 
speed of a moving mobile station. 

21. An apparatus according to claim 20 wherein the state machine is configured to 
change state in response to a change from frequency hopping to non-frequency 
hopping and vice versa. 

22. An apparatus according to claim 15 wherein the estimator is comprised of 
multiple linear estimators. 
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Fig. 3 
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